Trajectorial dissipation and gradient flow for the relative entropy in Markov chains
نویسندگان
چکیده
We study the temporal dissipation of variance and relative entropy for ergodic Markov Chains in continuous time, compute explicitly corresponding rates. These are identified, as is well known, case terms an appropriate Hilbertian norm; entropy, a Dirichlet form which morphs into version familiar Fisher information under conditions detailed balance. Here we obtain trajectorial versions these results, valid along almost every path random motion most transparent backwards direction time. Martingale arguments time reversal play crucial roles, recent work Karatzas, Schachermayer Tschiderer conservative diffusions. Extension developed to general convex divergences countable state-spaces. The steepest descent gradient flow properties variance, generalizations, studied with their respective geometries balance, leading very direct proof HWI inequality Otto Villani present context.
منابع مشابه
Taylor Expansion for the Entropy Rate of Hidden Markov Chains
We study the entropy rate of a hidden Markov process, defined by observing the output of a symmetric channel whose input is a first order Markov process. Although this definition is very simple, obtaining the exact amount of entropy rate in calculation is an open problem. We introduce some probability matrices based on Markov chain's and channel's parameters. Then, we try to obtain an estimate ...
متن کاملThe Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملGeodesic convexity of the relative entropy in reversible Markov chains
We consider finite-dimensional, time-continuous Markov chains satisfying the detailed balance condition as gradient systems with the relative entropy E as driving functional. The Riemannian metric is defined via its inverse matrix called the Onsager matrix K . We provide methods for establishing geodesic λ-convexity of the entropy and treat several examples including some more general nonlinear...
متن کاملDissipation, interaction, and relative entropy.
Many thermodynamic relations involve inequalities, with equality if a process does not involve dissipation. In this article we provide equalities in which the dissipative contribution is shown to involve the relative entropy (also called the Kullback-Leibler divergence). The processes considered are general time evolutions in both classical and quantum mechanics, and the initial state is someti...
متن کاملFluctuation Theorems for Entropy Production and Heat Dissipation in Periodically Driven Markov Chains
Asymptotic fluctuation theorems are statements of a Gallavotti-Cohen symmetry in the rate function of the time-averaged entropy production or heat dissipation of a process. Such theorems have been proved for various general classes of continuous-time deterministic and stochastic processes, but always under the assumption that the forces driving the system are time independent, and often relying...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Communications in information and systems
سال: 2021
ISSN: ['1526-7555', '2163-4548']
DOI: https://doi.org/10.4310/cis.2021.v21.n4.a1